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Abstract;  -f/ 
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-  Consider  a  finite  set  E,  a  weight  function  w :  E  -»IR,  and  two  matroids 
Mi  and  Mo  defined  on  E.  The  weighted  matroid  intersection  problem 

4 

consists  of  finding  a  set  fe  E,  independent  in  both  matroids,  that  maximizes 
32(w(e):  e  in  IJ.  ^  present  an  algorithm  of  complexity  0(nr(r  ♦  c  ♦  log  n))  for 
this  problem,  where  n  *  |E|,  r  =  min(rank(M|),  rank(M2)),  c  *  max(c  j ,  c2)  and, 

for  i  »  1,2,  Cj  is  the  complexity  of  finding  the  circuit  of  I  U  (e)  in  Mj  (or 

show  that  none  exists)  where  e  is  in  E  and  Is  E  is  independent  in  Mj  and  M2. 

VA>This  improves  the  complexity  of  earlier  algorithms  by  a  factor  r,  when 
c  i  O(n),  and  by  a  factor  n  when  max(c,  log  n)  i  O(r).  A  related  problem  is  to 
find  a  maximum  weight  set,  independent  in  both  matroids,  and  of  given 
cardinality  k  (if  one  exists).  Our  algorithm  also  solves  this  problem.  In 
addition,  we  present  a  second  algorithm  which,  given  a  feasible  solution  of 
cardinality  k,  finds  an  optimal  one  of  the  same  cardinality.  A  sensitivity 
analysis  on  the  weights  is  easy  to  perform  using  this  approach. 

1.  introduction: 

Let  E  be  a  finite  set,  Mj  and  M2  two  matroids  defined  on  E  and  w  :  E*IR 

a  weight  function.  The  weight  of  a  subset  Fs  E  is  defined  by 
w(F)  *  Z(w(e):  e  is  in  F).  The  weighted  matroid  intersection  problem 
consists  of  finding  a  maximum  weight  set  Is  E  which  is  Independent  in  both 
matroids. 

Let  k  be  a  positive  Integer.  Call  Fs  E  a  k-set  if  IFI  *  k.  Define  F  to  be 
feasible  if  It  is  independent  in  both  Mj  and  M2.  We  also  consider  the 
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problem  of  finding  a  maximum  weight  feasible  k-set  l£E,  if  one  exists. 

This  problem  is  denoted  by  (Pk). 

Problem  (Pk)  and  the  weighted  matroid  intersection  problem  have 

been  solved  in  polynomial  time  by  Edmonds  (1970,  1979],  Lawler  [1976],  and 
Frank  [1981].  Their  algorithms  start  with  I  *  0  and  increase  the  cardinality 
of  l  by  one  at  each  Iteration  until  an  optimum  set  is  found. 

We  discuss  a  new  algorithm  for  (Pk),  one  which  operates  in  a 

“horizontal"  fashion.  It  starts  with  a  feasible  k-set  I.  The  set  I  is  used  to 
construct  a  digraph  related  to  Glover's  state  graphs  [1985]  and  Lawler's 
border  graphs  [  1 976J.  We  then  use  negative  length  cycles  in  our  digraph  to 
find  an  improved  feasible  k-set.  (In  this  paper  all  cycles  and  paths  in 
digraphs  are  assumed  to  be  directed.)  The  procedure  is  repeated  until  an 
optimum  set  is  found.  In  constructing  our  digraph  from  I  at  each  Iteration, 
the  following  circuit  recognition  problem  arises  in  matroids  M  j  and  M2. 
Given  a  set  l£E,  independent  in  both  matroids,  and  e  in  E  -  I,  find  the  circuit 
of  I  +  e  in  M1  (or  show  that  none  exists)  for  i  *  1 , 2.  We  denote  by  c  the 

complexity  of  this  circuit  recognition  problem.  Note  that  we  use  summation 
notation  to  represent  set  union. 

This  "horizontal"  approach.  In  conjunction  with  the  introduction  of 
artificial  elements,  yields  a  second  algorithm  for  problem  (Pk).  It  has 

complexity  0(nk(k  ♦  c  ♦  log  n)),  where  n  -  IEI.  Our  second  algorithm  also 
solves  the  weighted  matroid  intersection  problem.  It  is  closely  related  to 
Lawler's  primal  algorithm,  the  main  difference  being  that,  at  each  iteration, 
it  only  requires  finding  a  shortest  path  between  two  prespecified  nodes  in  a 


digraph  with  nonnegative  arc  weights  and  therefore  does  not  need  the  more 
complex  labelling  procedure  used  by  Lawler.  This  accounts  for  the  term 
nk(k  ♦  log  n)  in  our  complexity  bound  instead  of  Lawler’s  n2k2. 

Our  development  uses  concepts  and  results  from  Glover’s  paper  on  the 
Generalized  Quasi-Greedy  Algorithm  [19851  We  include  them  here  to  make 
this  report  self-contained. 

2.  Preliminary  Results: 

Let  Mj  and  M2  be  two  matroids  defined  on  the  same  element  set  E. 

Throughout  this  section  we  assume  that  i  is  Independent  in  both  matroids. 
Let  2  be  a  subset  of  I  and  let  r  be  a  subset  of  E  -  I  such  that  III  -  I2’|.  We 
say  that  (2,  2')  is  an  I  swap  if  I  -  2  ♦  2*  is  independent  in  Mj  and  an 

I  back -swap  if  I  -  2  *  2*  is  independent  in  M2.  Also,  we  call  m(2,  D  a 

matching  if  it  represents  a  one-one  mapping  of  2  onto  2’;  m(2, 2’)  is  called 
an  I  matching  if  every  (e,  e')  in  m(2,  2')  is  an  I  swap,  and  an 

1  back-matching  if  every  (e,  e  )  in  m(2, 2')  is  an  I  back-swap. 

Lemma  i  :  Let  I  and  I*  be  independent  sets  in  a  matroid  li.  Let 

2  ■  I  -  P  and  2’  *  I*  -  I.  Choose  any  e  in  2  such  that  I’  +  e  is  dependent.  Then 
there  is  an  e'  in  2*  such  that  both  r  ♦  e  -  e’  and  I  ♦  e'  -  e  are  independent  in  M. 

Proof:  Since  I’  +  e  is  dependent,  it  contains  a  unique  circuit  l'(e). 
Clearly,  every  e’  in  l’(e)  -  e  will  satisfy  the  requirement  that  r  ♦  e  -  e’  be 
Independent.  We  need  to  show  that  at  least  one  such  e'  yields  I  ♦  e’  -  e 
independent. 


Note  that  l'(e)  -  e  is  not  contained  in  I  and  consider  I  ♦  r(e)  -  e.  But 
r(l  ♦  i*(e)  -  e)  i  r(l)  since  e  is  dependent  on  l‘(e)  -  e,  where  r  denotes  the  rank 
function  of  the  matroid.  Thus,  we  can  find  a  subset  I"  of  I  ♦  l*(e)  -e  which  is 
independent  and  has  the  same  cardinality  as  I.  Since  I  -  e  is  independent,  we 
can  take  r  ■  I  -  e  ♦  e*  for  some  e'  in  l*(e)  -l.  □ 

Lemma  2:  Let  I  and  I’  be  two  feasible  k-sets,  and  let  I  -  I  -  r  and 
r  ■  I*  -  I.  Then  there  is  at  least  one  I  matching  and  one  1  back-matching  of 

<2,  n 

Proof:  First  we  show  that  at  least  one  I  matching  exists.  Choose  an  e 
in  2  and  select  e’  in  2‘  such  that  both  I  ♦  e‘  -  e  and  1‘  ♦  e  -  e‘  are  independent 
in  M  j .  Note  that  such  an  e‘  exists  by  Lemma  1 .  We  then  have  an  I  swap 

(e,  e').  We  can  repeat  this  arguement  with  (2  -  e,  2’  -  e’)  in  the  role  of  (2,  2’) 
to  get  the  desired  I  matching  recursively. 

To  show  that  an  I  back-matching  exists,  it  suffices  to  interchange  the 
role  of  Mj  and  M2  in  the  definitions.  The  result  follows  from  the  existence 
of  an  I  matching  for  this  transformed  problem.  □ 

Lemma  3:  Let  I  be  an  independent  set  in  matroids  M  j  and  M2,  and 

consider  2£  I  and  2*£  E  -  I  where  121  3 12*1. 

(a)  If  m(2,  D  is  an  I  matching  but  not  an  I  swap,  then  there  also 
exists  an  I  matching  m’(2, 2')  different  from  m(2,  D. 

(b)  If  m(2,  2')  is  an  I  back-matching  but  not  an  I  back-swap,  then 
there  also  exists  an  I  back-matching  m'(2,  D  different  from  m(2, 2‘). 


Proof:  Since  (b)  follows  from  (a)  by  interchanging  the  role  of  fi|  and 
M2  in  the  definitions,  we  only  have  to  prove  (a). 

Let  F  and  F*  be  contained  in  2  and  2',  respectively,  such  that 

(i)  the  I  matching  m(2,  F)  induces  an  I  matching  of  (F,  F), 

(ii)  r  -  I  ♦  F  -  F  is  independent  inMj,  and 

(iii)  I*  ♦  f  -  f  is  dependent  in  Mj  for  every  (f,  f )  in  m(2,  F)  -  m(F,  F). 
Note  that  l0  ■  I  +  f  -  f  is  independent  in  Mj.  Thus  we  can  apply  Lemma  1  to 
l0  and  l*.  Since  r  ♦  f*  is  dependent  in  M|,  there  exists  e‘  in  F'  -  f  such  that 
I'  ♦  f  -  e'  (■  I  ♦  F  ♦  r  -  e'  -  F)  and  l0  ♦  e*  -  f  (*  I  ♦  e*  -  f)  are  independent  in 
Mj.  Thus,  (F,  F  +  r  -  e')  is  an  I  swap,  as  is  (f,  e‘).  Applying  Lemma  2  to 

(F,  F  ♦  f  -  e’)  and  adding  (f,  e')  yields  an  1  matching  of  (F  ♦  f,  F  ♦  f*), 
containing  (f,  e’).  If  we  add  the  remainder  of  m(X,  F)  to  this  I  matching,  we 
get  an  I  matching  different  from  m(2,  F).  □ 

Lemma  4:  Given  a  digraph,  let  C  and  C  be  the  arc  sets  of  two 
different  cycles.  Assume  that  the  two  cycles  contain  exactly  the  same 
nodes  and  let  C"  *  C  ♦  C,  where  an  arc  occurs  twice  in  C"  if  it  occurs  in  both 
C  and  C\  Then  C"  may  be  written  as  C"  ■  C1  ♦ ...  +  Cu,  u  1 3,  where  each  Ci 
induces  a  cycle  containing  at  least  one  fewer  node  than  C  and  C'. 

Proof:  Assume  the  nodes  contained  in  the  two  cycles  have  been 
indexed  v  j ,  v2, ... ,  vh  so  that  the  arcs  of  C  are  (Vj,  vj+  j )  for  i  =  1 , 2, ... ,  h 


(mod  h).  Since  C*  *  C,  there  Is  at  least  one  arc  (vq,  vp)  In  C*  such  that  q  >  p, 
p  *  1 .  Consider  the  paths  connecting  the  nodes  v  j ,  vp,  and  vq  in  each  of  the 
two  cycles,  say 

<pip.  Ppq,  Pq  j )  in  the  cycle  induced  by  C,  and 

(P  i  q‘,  (vq,  vp),  Pp|')  in  the  cycle  induced  by  C\ 

Recombine  these  paths  as  follows. 

^  1  =  ^  I  p'  ^p  1  ^  ^2  *  ^pqj  vp^»  an<*  ^3  =  ^  1  q '  ^q  P' 

Note  that  C,  does  not  contain  vq,  C2  does  not  contain  vj,  and  C3  does  not 

contain  vp.  In  addition  C2  and  C3  are  cycles  since  their  nodes  are  indexed  in 

ascending  order  and,  therefore,  are  not  repeated.  To  decompose  Cj  into 

cycles  it  suffices  to  trace  it,  starting  from  v  j.  Whenever  a  node  is  visited 

for  the  second  time  in  this  process,  a  cycle  of  the  decomposition  is 
identified.  □ 

Lemma  5:  Let  s  and  d  be  two  nodes  of  a  digraph,  and  let  P  and  P’  be 
the  arc  sets  of  two  different  paths  joining  the  source  s  to  the  destination  d 
and  containing  the  same  intermediate  nodes,  but  in  a  different  order.  Let 
p-  -  p  *  P*  where  an  arc  occurs  twice  in  P"  if  it  occurs  in  both  P  and  P\  Then 
P“  may  be  written  as  P"  a  Pj  +  P2  ♦  C3  ♦  ... +  Cy,  u  2  3,  where  Pj  and  P2  are 
paths  joining  the  source  s  to  the  destination  d,  but  containing  fewer 
intermediate  nodes  than  P  and  P’,  and  each  Cj  is  a  cycle. 
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Proof:  Identify  the  nodes  s  and  d  of  the  digraph  into  a  single  node  x. 
Then  P  and  P'  become  cycles,  and  we  can  apply  Lemma  4.  Exactly  two  of  the 
cycles  In  the  decomposition  Cj  ♦ ...  ♦  Cu,  u  2  3,  must  contain  x  since  there 
are  two  arcs  of  P  ♦  P‘  out  of  x  and  two  into  x.  Assume  these  two  cycles  are 
C  j  and  C2.  Going  back  to  the  original  digraph,  C  j  and  C2  yield  the  required 

paths  Pj  and  P2.  0 


3.  The  First  Algorithm  : 

In  this  section,  we  show  how  to  solve  problem  (Pk),  given  a  feasible 

k-set  I.  (Finding  the  initial  set  I  is  not  considered  in  this  section;  see  the 
beginning  of  Section  4.) 

We  construct  a  bipartite  digraph  B(l)  -  (V,  V',  A)  from  I  as  follows. 

We  get  a  node  for  each  e  in  E,  namely  a  node  in  V  for  each  e  in  I  and  one  in  V’ 
for  each  e’  in  E  -  I.  For  each  ej  in  I,  we  construct  an  arc  (ej,  ey)  with  weight 

w(ej,  ey) *  w(ej)  -  w(ey)  provided  I  -  ej  ♦  ey  is  independent  in  Mj. 

Similarly,  for  each  ey  in  E  -  I,  we  construct  an  arc  (ey,  ej)  with  weight 

w(ey,  ef)  =  0  provided  I  -  ej  ♦  ey  is  independent  in  li2.  Note  that  our  digraph 

BO)  is  closely  related  to  Lawler's  border  graph.  The  difference  is  that,  if 
I  +  ey  is  independent  InMp  then,  in  BO),  an  edge  (6j,  ey)  exists  for  all  ej  in 

l  and,  if  I  +  ey  is  independent  in  M2,  then  (ey,  ej)  exists  for  all  e1  in  i.  On 
Lawler's  border  graph,  none  of  these  edges  exist.) 

Theorem  1:  Let  I  and  I*  be  two  feasible  k-sets  and  let  2  =  1-1*  and 
r  «  I'  -  I.  Then  the  nodes  of  BO)  associated  with  2*2'  induce  a  set  of 
disjoint  cycles  in  BO). 

Proof:  By  Lemma  2,  there  exists  at  least  one  I  matching  and  one 
i  back-matching  of  (Z,  Z).  For  every  l  swap  (ej,  ey)  in  the  I  matching, 

I  -  es  ♦  ey  is  independent  in  Mj,  and,  therefore,  by  construction  there  is  an 

arc  (ej,  ey)  in  BO).  Similarly,  for  every  I  back-swap  (ej,  ey)  in  the  I  back- 
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matching,  I  -  ej  ♦  ey  is  independent  in  M2,  and,  therefore,  by  construction 
there  is  an  arc  (ey,  ep  in  B(l).  Clearly,  when  we  consider  the  arcs  that  arise 

from  the  above  I  matching  and  I  back-matching,  we  get  a  union  of  disjoint 
cycles  of  BO).  □ 

Let  C  be  a  cycle  of  B(l).  We  define  the  weight  of  this  cycle,  w(C),  to 
be  the  sum  of  the  weights  of  the  arcs  in  the  cycle.  Note  that 
w(C) 3  w(2)  -  w (D,  where  2  and  2*  represent  the  nodes  of  C  in  V  and  V’, 
respectively. 

Theorem  2:  Let  I  be  a  feasible  k-set,  and  let  C  be  a  cycle  of  B(l).  Let 
the  I  matching  m(2,  D  represent  the  arcs  of  C  directed  from  V  to  V‘,  and  let 
mb(2,  D  be  the  I  back-matching  representing  those  directed  from  V’  to  V. 

If  I  -  2 +  2'  is  not  feasible,  then  there  is  a  cycle  C0  in  BO)  such  that 

(i)  the  nodes  of  C0  constitute  a  proper  subset  of  the  nodes  of  C,  and 

(ii)  w(C)  <  0  implies  w(CQ)  <  0. 

Proof:  Since  I  -  2  +  2’  is  not  feasible,  either  (2, 2')  is  not  an  l  swap, 
or  it  is  not  an  l  back-swap,  or  both. 

Suppose  (2, 2')  is  not  an  I  swap.  Then,  by  Lemma  3,  there  is  another 
I  matching  m’(2,  2').  If  we  replace  the  arcs  of  m(2,  D  in  C  by  the  arcs  of 
m‘(2, 2'),  we  get  a  new  set  C’  with  w(C)  =  w(C).  But  C’  will  be  either  a  set 
of  disjoint  cycles  or  a  single  cycle.  In  the  first  case,  each  of  the  dfsjoint 
cycles  satisfies  0),  and  (ii)  must  hold  for  at  least  one  of  these  cycles,  in 


the  second  case  we  apply  Lemma  4  with  cycles  C  and  C\  Then  C"  -  C  ♦  C  can 
be  written  as  Cj  ♦ ...  ♦  Cy,  where  each  Cj  satisfies  (i).  Again,  (ii)  must  hold 

for  at  least  one  of  the  cycles  C|  since  w(C')  <  0  implies  w(Cj)  <  0  for  at 
least  one  i  ■  1 , ... ,  u. 

On  the  other  hand,  if  (2, 2‘)  is  not  an  I  back-swap,  the  theorem 
follows  by  a  similar  proof,  using  the  I  back-matching  mb(2,  D  and  another 

I  back-matching  mb'(2,  2'),  which  we  know  exists  by  Lemma  3.  □ 

Combining  Theorems  1  and  2,  we  get  the  following  theorem.  It 
consolidates  our  previous  results  and  shows  the  equivalence  of  solving 
problem  (Pk)  and  finding  negative  weight  cycles  in  BO). 

Theorem  3-.  Assume  I  is  a  feasible  k-set. 

(i)  I  is  optimal  for  (Pk)  if  and  only  if  there  are  no  negative  cycles  in 
B(l). 

(10  Let  C  be  a  negative  cycle  in  BO)  with  no  negative  cycle  on  a 
subset  of  its  nodes,  and  let  2  and  2'  be  the  nodes  of  C  In  V  and  V', 
respectively.  Then  r  ■  I  -  2  +  2’  Is  a  feasible  k-set  such  that 

W(i’)  >  WO). 

Proof:  Statement  00  follows  directly  from  Theorem  2  and  from  the 
fact  that  the  weight  of  the  new  solution  Is  w(D  =  wO)  -  w(C),  which  Is 
greater  than  wO). 

Now  we  prove  (i).  Assume  there  is  a  negative  cycle  in  BO).  If 
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I*  *  I  -  2  ♦  r  is  not  feasible,  where  2  and  2‘  are  the  nodes  of  C  in  V  and  V', 
respectively,  then,  by  Theorem  2,  there  is  another  cycle  C0  on  a  subset  of 

the  nodes  of  C  such  that  w(C0)  <  0.  Repeating  this  arguement  with  C0  in 

place  of  C,  we  must  eventually  be  able  to  find  a  negative  cycle  such  that 
r  -  I  -  2  ♦  2*  is  feasible.  But  then  w(l  )  *  w(l)  -  w(C)  >  w(l). 

Now  assume  that  I  is  not  optimal.  Consider  r  such  that  w(D  >  w(l). 
From  Theorem  1  we  get  a  set  of  disjoint  cycles  in  BCD,  the  sum  of  whose 
weights  must  be  negative.  Thus  at  least  one  of  these  cycles,  say  C,  must  be 
a  negative  cycle  in  BO ).  □ 

Theorem  3  yields  an  obvious  primal  algorithm.  We  start  with  a 
feasible  k-set  I  and  use  B(l)  to  find  an  improved  solution.  We  continue  until 
we  find  a  BO)  with  no  negative  cycles. 

The  algorithmic  issues  are  (i)  the  construction  of  BO),  (ii)  when  a 
negative  cycle  exists,  how  to  find  one  such  that  there  is  no  other  negative 
cycle  on  a  subset  of  its  nodes,  and  (iii)  the  number  of  iterations  needed  to 
reach  optimality.  We  treat  these  questions  briefly  now. 

To  construct  BO),  we  must  solve  the  following  circuit  recognition 
problem  for  each  ey  in  E  -  I  and  for  both  of  the  matroids  Mj,  i  -  1,2:  Check 

whether  I  ♦  ey  is  dependent  in  Mj,  and,  if  it  is,  find  the  unique  cycle  of 
I  ♦  e j*.  This  task  requires  time  c  for  each  ey  in  E  -  I.  So  the  complexity  of 
constructing  BO)  is  0(nc). 

To  find  a  negative  cycle  with  the  required  property,  one  possibility  is 
to  use  the  so-called  "matrix  multiplication"  algorithm  for  finding  shortest 
paths  between  all  pairs  of  nodes  of  a  digraph.  Define  the  nxn  matrix  A  so 
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that  ajj  *  0  and,  for  1  *  j,  a^  is  the  weight  of  arc  (e^  ej)  if  It  exists  in  B(l), 

o®  otherwise.  It  is  well-known  that,  if  the  usual  addition  and  multiplication 
are  replaced  by  the  operations  min  and  ♦,  then  the  tth  power  of  A  has  the 
following  interpretation.  Let  ajj(t)  be  an  element  of  A*.  Then  a^ j(t)  is  the 
smallest  weight  of  a  path  from  i  to  j  that  contains  at  most  t  arcs;  see 
Lawler  {19761.  In  particular,  if  a^(t)  <  0,  then  a  negative  cycle  with  at  most 

t  arcs  can  be  identified  in  B(l).  Also,  the  smallest  value  of  t  such  that  A* 
has  a  negative  diagonal  element  provides  a  negative  cycle  such  that  no 
negative  cycle  exists  on  a  subset  of  its  nodes.  Note  that,  since  HI  *  k  and 
BO)  is  bipartite,  at  most  2k  matrix  multiplications  are  needed.  So  the 
complexity  of  finding  a  negative  cycle  with  the  required  property  is  0(n3k). 
Actually,  the  factor  n3  can  be  decreased  by  using  fast  matrix  multiplication 
algorithms. 

Finally,  we  consider  the  number  of  iterations  needed  to  reach 
optimality.  We  assume  that  w(e)  is  integer  for  all  e  in  E.  Let 
W  =  max(w(e):  e  in  E)  -  min(w(e):  e  in  E), 
and  assume  W  >  0  (otherwise  the  problem  is  trivial).  At  first  it  appears 
that  the  number  of  iterations  could  be  as  large  as  kW;  however,  by  using  a 
classical  scaling  technique  on  the  weights  we  need  at  most  k(  1  ♦  flog  wl ) 
iterations.  This  is  achieved  as  follows.  Add  min(w(e):  e  in  E)  to  all  the 
weights.  The  new  weights  w'(e)  are  nonnegative.  Let 
w'(e)  -  ap(e)2p  ♦ ...  ♦  a0(e), 

where  p  =  Hog  wl  and  aj(e) 8  0  or  1  for  i 8  0,  l, ... ,  p.  Instead  of  solving  the 
problem  (Pk)  with  the  weights  w’(e),  we  first  solve  it  with  the  weights 


ap(e)2p.  With  these  weights  at  most  k  iterations  are  needed  to  reach  an 

optimum  solution,  since  an  improvement  of  at  least  2P  is  achieved  each 
iteration  and  the  optimum  value  is  at  most  k2p.  Then  we  solve  the  problem 
(Pk)  with  the  weights  ap(e)2p  +  ap_j(e)2p“',  starting  from  the  optimum 

solution  found  for  the  previous  weights.  Again,  at  most  k  iterations  are 
needed.  We  continue  this  process,  including  one  more  digit  in  the  binary 
expansion  of  w‘(e)  each  time,  until  the  problem  (Pk)  is  solved  for  the  actual 

weights  w'(e). 

Therefore,  the  overall  complexity  of  the  algorithm  is 
0((n3k2  ♦  nkc)(  1  +  log  W)).  Although  this  complexity  is  high,  the  approach 
may  have  merits  in  the  context  of  sensitivity  analysts.  Given  an  optimum 
solution  for  some  set  of  weights.  Theorem  3  provides  an  optimality 
condition  that  can  be  tested  for  a  perturbed  set  of  weights.  If  the 
optimality  condition  is  violated,  reoptimizing  using  the  above  algorithm 
may  be  more  efficient  in  practice  than  starting  from  scratch,  as  the  other 
algorithms  for  matroid  intersection  require. 

This  algorithm  may  also  be  useful  when  an  optimization  problem,  such 
as  the  traveling  salesman  problem,  is  solved  using  a  Lagrangian  relaxation 
that  happens  to  be  the  problem  (Pk)  for  some  matroids  M  j  and  M2  (the 

weights  being  a  function  of  the  Lagrange  multipliers).  To  get  a  tight 
relaxation  one  often  optimizes  the  Lagrange  multipliers  by  an  iterative 
method,  such  as  subgradient  optimization.  Thus,  at  each  iteration  the 
weights  are  modified.  We  plan  to  try  this  approach  for  the  traveling 
salesman  problem  in  a  forthcoming  paper. 


4.  The  Second  Algorithm  : 

In  this  section  we  show  how  the  ideas  developed  in  the  previous 
algorithm  can  be  modified  to  (i)  avoid  assuming  that  we  are  given  an  initial 
set  to  start  the  algorithm,  (ii)  reduce  the  complexity,  and  (iii)  solve  the 
weighted  matroid  intersection  problem  as  well  as  problem  (Pk). 

First,  consider  the  question  of  getting  an  initial  set  for  problem  (Pk). 

We  can  start  by  applying  the  greedy  algorithm.  Initially  l0  *  0,  and ,  at  each 

iteration,  an  element  e  in  E  -  l0  is  added  to  l0  if  l0  ♦  e  is  independent  in  both 

matroids  and  e  has  maximum  weight  over  all  elements  f  in  E  -  l0  such  that 

10  ♦  f  is  independent  in  at  least  one  of  the  two  matroids.  The  greedy 

algorithm  is  stopped  when  such  an  element  e  cannot  be  found.  Note  that,  at 
termination,  |l0l  i  1.  If  llQ|  i  k,  we  are  done.  Otherwise,  consider  a  set  A  of 

k  -  |l0)  artificial  elements,  where  E/)  A  *  0.  Let  F  *  E  ♦  A.  We  define  two 

matroids  M ^ (F)  and  M2(F)  on  the  element  set  F  as  follows.  For  i  *  1 , 2,  K  E 

and  J?  A,  the  set  I  +  J  is  independent  in  Mj(F)  if  and  only  if  I  is  independent 

in  Mj.  The  problem  (Pk)  relative  to  these  new  matroids  will  be  denoted  by 

<Pkl  F). 

Note  that  to  define  (Pkl  F)  completely  we  need  to  give  weights  to  the 
artificial  elements.  By  giving  them  large  negative  weights  we  can 
guarantee  that,  if  (Pk)  is  feasible,  then  an  optimum  solution  to  (Pkl  F)  does 

not  contain  any  artificial  elements  and  therefore  is  also  optimum  for  (Pk). 
Thus,  the  question  of  finding  an  Initial  solution  for  the  algorithm  of  Section 


3  is  resolved:  it  suffices  to  solve  (Pkl  F)  starting  from  l0  ♦  A  as  defined 
above. 

However,  In  this  section  we  have  a  different  algorithm  in  mind.  We 
will  give  large  positive  weights  to  all  the  artificial  elements.  Then, 
obviously,  the  initial  solution  I  -  l0  ♦  A  Is  optimal  for  (Pkl  F).  So,  by 

Theorem  3,  the  digraph  BO)  relative  to  problem  (Pkl  F)  contains  no  negative 
cycles. 

Define  the  digraph  SO)  from  BO)  by  splitting  one  of  the  nodes  that 
arose  from  an  artificial  element,  say  a  in  A,  into  a  source  node  s  and  a 
destination  node  d,  where  the  arcs  out  of  s  in  SO)  are  those  that  were  out  of 
a  in  BO)  and  the  arcs  into  d  in  SO)  are  those  into  a  in  BO). 

Theorem  4:  Let  I  be  an  optimal  k-set  of  (Pkl  H),  where  E£  He  F.  Let  P 
be  an  s-d  path  in  SO),  and  let  the  I  matching  m(Z,  2')  represent  the  arcs  of  P 
directed  from  V  to  V’  and  the  I  back-matching  m&(2, 2')  represent  those 
directed  from  V'  to  V  (recall  that  s  and  d  are  both  associated  with  element 
a).  If  I  -  2  ♦  I  is  not  feasible,  then  there  is  an  s-d  path  P0  in  SO)  such  that 

0)  the  intermediate  nodes  of  PQ  constitute  a  proper  subset  of  those 
of  P,  and 

(11)  w(P0)  i  w(P). 

Proof:  Since  I  -  2  ♦  2’  is  not  feasible,  either  (2, 2')  is  not  an  I  swap  or 
it  is  not  an  I  back-swap,  or  both.  Assume  it  is  not  an  I  swap.  Then,  by 
Lemma  3,  there  is  another  l  matching  m*(2, 2').  If  we  replace  the  arcs  of 


m(2,  D  In  P  by  those  of  m'(2, 2‘),  we  get  a  new  set  P‘  with  w(P‘)  -  w(P),  and 
P‘  will  be  either  the  union  of  cycles  and  one  s-d  path  which  are  all  node 
disjoint,  or  a  single  s-d  path.  In  the  first  case,  the  s-d  path  satisfies  (i) 
and  (ii),  where  (ii)  follows  from  the  fact  that  SO)  does  not  contain  negative 
cycles.  In  the  second  case  we  apply  Lemma  5  with  paths  P  and  P'.  Then  the 
path  Pj  defined  in  the  statement  of  Lemma  5  satisfies  conditions  (i)  and 

(ii),  again  using  the  fact  that  SO)  does  not  contain  negative  cycles. 

When  (2, 2’)  is  not  an  I  back-swap  the  result  is  proved  in  a  similar 
fashion.  □ 

Observe  that  the  fact  that  P  joins  s  to  d  is  unimportant  in  the  proof. 
Thus,  the  statement  of  the  above  theorem  holds  for  any  path  P  that  contains 
the  same  number  of  elements  from  V  and  V’. 

Theorem  5:  Let  I  be  an  optimal  k-set  for  problem  (Pkl  H),  where 

EcHs  F,  and  let  SO)  be  obtained  from  BO)  by  splitting  an  artificial  element 
a  into  s  and  d. 

(i)  Problem  (Pkl  H  -  a)  has  no  solution  if  and  only  if  there  is  no  s-d 
path  in  SO). 

(ii)  Let  P  be  a  shortest  s-d  path  such  that  every  s-d  path  defined  on  a 
proper  subset  of  its  nodes  has  a  strictly  larger  weight,  and  let  2 
and  2*  be  the  nodes  of  P  in  V  and  V',  respectively,  (s  and  d  both 
give  rise  to  a  in  2.)  Then  r  »  I  -  2  ♦  2'  is  an  optimal  k-set  for 
problem  (Pkl  H  -  a). 


Proof:  We  first  prove  (i).  If  there  Is  an  s-d  path  P  such  that  the  set 
I  -  2  ♦  F  defined  In  Theorem  4  Is  not  feasible,  then  there  exists  another  s-d 
path  going  through  a  proper  subset  of  the  nodes  of  P.  Repeating  Theorem  4 
with  this  new  path,  we  must  eventually  find  a  set  I*  «  I  -  I  ♦  2'  which  is 
feasible  for  (Pkl  H).  Since  a  Is  In  2, 1’cH-a  and,  therefore,  r  is  also 

feasible  for  (Pkl  H  -  a).  Conversely,  assume  that  (Pkl  H  -  a)  has  a  solution, 

say  I*,  and  let  2*1-1*  and  2’ s  l‘  -  I.  Then  the  I  swap  (2,  D  induces  an  s-d 
path  and  possibly  a  set  of  disjoint  cycles  in  SO),  as  a  consequence  of 
Theorem  l. 

Now  we  prove  (ii).  Consider  an  optimal  set  I*  for  (Pkl  H  -  a).  Define 

S  *  I  -  I*  and  S*  *  I*  -  I.  The  I  swap  (S,  S*)  Induces  an  s-d  path,  say  P*  and 
possibly  a  set  of  disjoint  cycles  In  SO).  Since  there  are  no  negative  cycles 
in  SO),  it  follows  that  w(S)  -  w(S*)  >  w(P*).  In  addition,  w(P*)  i  w(P)  * 
w(2)  -  w(D  since  P  is  a  minimum  length  s-d  path  In  SO).  So  wO*)  i  w(D 
since  I*  ■  I  -  S  ♦  S*  and  I*  ■  I  -  2  +  2*.  Also  note  that  I*  is  feasible  in  (Pkl  H) 

by  Theorem  4,  and,  since  a  is  in  2,  It  follows  that  l‘  is  feasible  in  (Pkl  H  -  a). 

So  I'  is  optimal  in  (Pkl  H  -  a).  □ 

Theorem  5  provides  the  basis  for  an  algorithm.  Start  with  the  set 
I  =  l0  ♦  A  This  set  is  optimal  for  problem  (Pki  F)  if  we  assign  a  large 

positive  weight  to  all  the  artificial  elements.  Construct  BO),  and  then  50) 
by  splitting  some  artificial  element  a  of  BO).  Find  a  shortest  path  P  from 
the  resulting  source  s  to  destination  d,  with  the  added  condition  that  every 
s-d  path  defined  on  a  proper  subset  of  the  nodes  of  P  has  a  strictly  larger 


weight.  Then  the  set  r  defined  in  Theorem  5(ii)  is  an  optimal  k-set  for 
problem  (Pkl  F  -  a).  Repeat  this  process  with  r  in  place  of  l,  until  all  the 
artificial  elements  have  been  split.  When  this  occurs,  the  resulting  k-set  is 
optimal  in  (Pk). 

Note  that  this  algorithm  requires  at  most  k  iterations.  In  fact  the 
number  of  iterations  is  k  -  ll0l  since  exactly  one  artificial  element  is 

removed  at  each  iteration.  (If  at  some  iteration  2*1-1'  contained  at  least 
one  other  artificial  element  b  in  addition  to  a,  then  r  *  I  ♦  b  -  e  would  be  a 
feasible  k-set  with  larger  weight  than  r  for  some  element  e  of  r  -  A,  a 
contradiction.) 

We  now  consider  the  complexity  of  finding  a  shortest  s-d  path  with 
the  required  property. 

In  the  first  iteration  the  arc  weights  in  B(l0  ♦  A)  are  all  nonnegative. 

To  see  this,  consider  first  an  arc  (a,  f),  where  a  is  artificial.  Then 
w(a,  f)  *  w(a)  -  w(f)  >  0  since  w(a)  has  been  chosen  large  enough.  Now 
consider  an  arc  (e,  f),  where  e  is  in  lQ.  Since  the  arc  (e,  f)  occurs  in 

Bd0  +  A),  the  set  l0  ♦  f  -  e  is  independent  in  (i1 .  But  then  w(e)  i  w(f)  since  e 

has  been  chosen  by  the  greedy  algorithm  in  the  construction  of  l0.  So,  again, 

w(e,  f)  i  0.  Finally,  when  e  is  not  In  l0  +  A,  w(e,  f)  *  0. 

Since  all  the  arc  weights  are  nonnegative  in  B(l0  ♦  A),  and  thus  also  in 

S(l0  ♦  A),  a  shortest  s-d  path  P  can  be  found  by  Dijkstra’s  algorithm.  Using 

the  fast  implementation  of  Fredman  and  Tarjan  [1984],  the  complexity  of 
this  step  Is  at  most  0(kn  ♦  n  log  n).  Furthermore,  the  restriction  that  every 
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path  on  a  subset  of  the  nodesAhas  a  strictly  larger  weight  can  be  obtained  by 
adding  a  very  small  positive  €  to  all  the  arc  weights  of  S(l0  ♦  A). 

Now  we  show  that  nonnegative  arc  weights  in  B(l)  can  be  preserved 
throughout  the  algorithm. 

Define  a  variable  D(e)  associated  with  each  node  of  the  digraph  B(l) 
and  a  reduced  weight  w‘(e,  f)  -  w(e,  f)  ♦  D(e)  -  D(f)  associated  with  each  arc 
of  B(l).  In  terms  of  the  reduced  weights,  the  length  of  an  s-d  path  P  is 
w‘(P)  -  w(P)  +  D(s)  -  D(d)  since,  for  any  intermediate  node  e  of  P,  the 
variable  D(e)  cancels  out  on  the  two  arcs  of  P  that  contain  e.  But  D(s)  -  D(d) 
is  a  constant  that  does  not  depend  on  P.  This  means  that  it  is  equivalent  to 
solve  the  shortest  path  problem  in  BO)  with  the  reduced  weights  w*  instead 
of  the  original  weights  w.  The  next  theorem  provides  a  choice  for  the 
variables  D(e)  that  guarantees  nonnegative  reduced  weights  from  one 
iteration  to  the  next.  This  result  is  closely  related  to  Theorem  4  in  Glover 
[  1 985 J. 

Theorem  6:  Let  I  be  an  optimal  k-set  for  problem  (Pkl  H)  where 

E<=Hs  F,  and  assume  that  an  s-d  path  exists  in  50).  Set  D(e)  to  be  the  length 
of  a  shortest  s-e  path  in  SO),  for  every  e  in  H.  Let  I*  be  defined  as  in 
Theorem  5(ii).  Then  the  reduced  weights  w‘(e,  f)  =  w(e,  f)  ♦  D(e)  -  D(f)  are 
nonnegative  for  every  arc  of  the  digraph  SO'). 

Proof:  First  we  show  that  the  choice  of  D(e)  gives  nonnegative 
reduced  weights  on  the  arcs  of  SO).  Consider  f  in  H.  Since  D(f)  is  the  length 
of  a  shortest  s-f  path,  we  must  have  D(f)  i  D(e)  ♦  w(e,  f)  for  every  e  in  H 
such  that  (e,  f)  is  an  arc  of  SO).  This  proves  the  result  for  SO). 


Let  P  be  the  shortest  s-d  path  that  gives  rise  to  I*  in  Theorem  5(ii), 
and  let  P,  be  a  subpath  of  P  from  s  to  some  node  ej.  Consider  the  l  matching 

m(2,(i),  2,‘(i))  induced  by  the  arcs  of  P,  going  from  V  to  V*  and  the  I  back- 
matching  mb(22(i),  22’(i))  induced  by  the  arcs  of  P,  going  from  V*  to  V.  The 
elements  of  these  two  matchings  induce  subpaths  of  P.  By  Theorem  4, 

1,(0  -  I  -  2,(0  ♦  2,‘(i)  and  l2(i)  *  I  -  22(i)  ♦  22'(i)are  feasible.  (The 

statement  of  Theorem  4  holds  for  any  path  P  that  contains  the  same  number 
of  elements  from  V  and  V‘,  as  was  already  observed.) 

We  construct  a  digraph  N,  as  follows.  The  nodes  of  N,  are  the  same  as 

those  of  5(0.  If  (e,  e')  is  an  I  ,(i)  swap,  then  (e,  e')  is  an  arc  of  N,;  and  if 
(e,  e  )  is  an  l2(i)  back-swap,  then  (e‘,  e)  is  an  arc  of  N,.  Note  that  N,  is  not 
bipartite  in  general. 

We  will  show  that  the  choice  of  D(e)  gives  nonnegative  reduced 
weights  on  the  arcs  of  N,.  This  Is  done  by  Induction  on  the  nodes  of  P, 

starting  from  e,  *  s.  Note  that  when  we  reach  e,  3  d,  we  will  have  N,  =  S(l'), 
and  the  theorem  will  be  proved. 

When  e,  *  s,  we  have  N,  =  5(1),  and  the  result  has  been  proved  above. 
Now  let  ej  be  a  node  of  P  for  which  the  result  holds,  and  let  ej  be  the  node 
following  e,  on  the  path  P.  There  are  two  possibilities:  e,£  V  and  e V',  or 
e,fe  V*  and  ef  V. 

First  suppose  that  e,  is  in  V  and  ej  is  in  V\  Then  l2(j)  ■  l2(i)  and, 
therefore,  the  arcs  that  arise  from  l2(j)  back-swaps  in  Nj  are  the  same  as 


V — - r — w  v  ■  !T  ir-  »  v-»  « 


those  In  Nj.  Thus,  they  have  nonnegative  reduced  weights  by  the  induction 
hypothesis.  On  the  other  hand,  If (j)  -  I  t(i)  -  e{  +  ej.  Since  the  arc  (e^  ej)  is 
on  the  shortest  s-d  path  P,  we  have  the  following  equation: 

D(ej)  -  D(ej)  ♦  w(e{)  -  w(ej).  (*) 

Consider  any  arc  (ep,  eq)  that  is  an  I  j(j)  swap,  but  not  an  I  f (i)  swap.  So 

l*  *  1 1  (j)  -  ep  +  eq  «  I  f  (1)  -  ep  ♦  eg  -  6|  +  ej  is  independent  in  the  first 
matron 

,f  (ep»  edJ  3  (ej*  ei)' then  w(V  "  w(eqJ  +  D(eP)  ‘  D(eq)  =  °*  as  a 
consequence  of  equation  (*). 

If  ep  *  ej  and  eq  *  e^,  then  (ej,  eq)  is  an  I  f  (1)  swap.  Therefore, 
w(ej)  -  w(eq)  ♦  D(ej)  -  D(eq)  1 0  by  Induction.  Combining  this  inequality 
with  (*)  we  get  w(ep)  -  w(eq)  ♦  D(ep)  -  D(eq)  i  0. 

A  similar  arguement  applies  when  ep  *  ej  and  eq  =  e,. 

Finally,  suppose  ep  *  ej  and  eq  *  ej(  Since  (ep,  eq)  is  not  an  I  |(i) 

swap,  yet  I*  is  Independent  In  the  first  matroid,  It  follows  from  Lemmas  2 
and  3  that  both  (ep,  ej)  and  (ej,  eq)  are  I  j(i)  swaps.  This  gives  the  two 
inequalities 

w(ep)  -  w(ej)  ♦  D(ep)  -  D(ej)  i  0  and  w(ej)  -  w(eq)  ♦  D(ej)  -  D(eq)  1 0. 
Summing  and  using  (*)  we  get  w(ep)  -  w(eq)  ♦  D(ep)  -  D(eq)  i  0.  This 
completes  the  proof  when  is  in  V  and  ej  Is  in  V’. 

Now  suppose  that  ej  is  in  v,  and  ej  is  in  V.  Then  I  ,(j)  =  i  ,(D,  and. 
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therefore,  the  arcs  of  Nj  that  arise  from  I  |(j)  swaps  have  nonnegative 

reduced  weights.  On  the  other  hand,  l2(j) =  I2O)  ~  ej +  ei-  Since  ^ei*  ej^ is 
on  the  shortest  s-d  path  P,  we  have  the  equation 

D(e{)  -  D(ej).  (**) 

Consider  any  arc  (ep,  eq)  that  is  an  l2(j)  back-swap  but  not  an  l2(i) 
back-swap. 

If  (ep,  eq)  *  (ej,  ej),  then  the  reduced  weight  of  arc  (ep,  eq)  is 
D(ep)  -  D(eq) »  0  as  a  consequence  of  (**). 

If  ep  =  ej  and  eq  *  et,  then  (et,  eq)  is  an  l2(i)  back-swap.  Therefore, 
its  reduced  weight  satisfies  Dtej)  -  D(eq)  2 0  by  induction.  This  and 
equation  (**)  show  that  D(ep)  -  D(eq)  2  0.  The  proof  is  similar  when  ep  *  ej 
and  eq  *  ej. 

Finally,  if  ep  *  ej  and  eq  -  ej,  it  follows  from  Lemmas  2  and  3  that 
(ep,  ej)  and  (ei(  eq)  are  l2(i)  back-swaps.  Thus,  D(ep)  -  D(ej)  2  0  and 
D(e,)  -  D(eq)  2  0  by  induction.  Using  (**)  once  more,  we  get  D(ep)  -  D(eq)  2  0. 

Thus,  the  reduced  weights  of  all  the  arcs  of  Nj  are  nonnegative.  □ 

The  variables  D(e)  needed  in  Theorem  6  to  guarantee  nonnegative 
reduced  arc  weights  are  actually  computed  in  the  course  of  finding  a 
shortest  s-d  path  in  S(l).  Thus  no  extra  computations  are  needed.  We 
summarize  the  complexity  of  the  algorithm:  0(k)  iterations  and,  in  each 
iteration,  time  0(nc)  for  constructing  SO)  and  time  0(nk  ♦  n  log  n)  for 
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finding  a  shortest  s-d  path  and  updating  the  variables  D(e).  Therefore,  the 
overall  complexity  of  the  algorithm  is  0(nk(k  ♦  c  +  log  n)). 

The  algorithm  provides  an  optimum  solution  to  (Pkl  H)  for  every 
Es  HeF.  In  terms  of  the  initial  set  E,  this  means  that  we  have  an  optimum 
solution  of  (Ph)  for  every  h  i  k.  Therefore,  by  putting  k  *  r,  the  algorithm 

can  be  used  to  solve  the  weighted  matroid  intersection  problem.  It  suffices 
to  keep  the  best  solution  generated  in  the  course  of  the  algorithm. 

In  this  section  our  motivation  for  introducing  k  -  |I01  artificial 

elements  with  large  positive  weights  was  to  capitalize  on  the  results  of 
Section  3.  However,  in  practice,  the  construction  of  SO)  can  be  simplified 
by  adding  only  one  artificial  source  node  s  and  one  artificial  sink  node  d  to 
B(l)  at  each  iteration.  The  arcs  (ej,  ey)  can  be  removed  from  SO)  if  I  ♦  ey  is 

independent  in  M|  for  any  in  I.  The  reason  for  this  is  that  a  shortest  s-d 

path  would  go  directly  from  s  to  ey  as  a  consequence  of  the  existence  of 

nonnegative  reduced  weights.  Similarly,  the  arcs  (ey,  ep  can  be  removed  if 

l  +  ey  is  independent  in  M2,  for  any  e\  in  I,  as  a  shortest  s-d  path  would  go 

directly  from  ey  to  d.  To  sum  up,  our  algorithm  can  be  applied  to  Lawler's 

border  graph  with  an  added  source  node  s  joined  to  every  node  ey  in  E  -  I 

such  that  I  ♦  ey  is  independent  in  M  j,  and  a  destination  node  d  joined  to 

every  node  ey  such  that  I  +  ey  is  independent  in  M2.  The  goal  is  the  same  at 

each  iteration  as  in  Lawler's  primal  algorithm.  The  increased  efficiency  of 
our  algorithm  can  be  attributed  to  the  use  of  nonnegative  reduced  weights  in 
the  search  for  shortest  paths. 


24 


References : 


J.  Edmonds,  "Submodular  Functions,  Matroids  and  Certain  Polyhedra," 

Combinatorial  Structures  and  their  Applications.  Proceedings  of  the 
Calgary  International  Conference.  R.  Guy,  editor,  Gordon  and  Breach, 
New  York  (1970),  69-87. 

J.  Edmonds,  Tlatroid  Intersection,"  Annals  of  Discrete  Mathematics  4 
(1979),  39-49. 

A.  Frank,  "A  Weighted  Matroid  Intersection  Theorem,"  Journal  of  Algorithms 
2(1981),  328-336. 

M.  L.  Fredman  and  R.  E.  Tarjan,  "Fibonacci  Heaps  and  their  Uses  in  Improved 
Network  Optimization  Algorithms,"  Proceedings  of  the  25th  Annual 
IEEE  Symnosium  on  the  Foundations  of  Computer  Science  ( 1 984), 

338  -  346. 


F.  Glover,  “The  Generalized  Quasi-Greedy  Algorithm  for  Constrained  Minimum 
Weight  Matroid  Bases,"  MSIS  Series,  Report  No.  85-1,  Graduate  School 
of  Business,  University  of  Colorado,  Boulder  ( 1 985). 

E.  L.  Lawler,  Combinatorial  Optimization:  Networks  and  Matroids.  Holt, 
Rinehart  and  Winston,  New  York  (1976). 


